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This paper investigates the necessary optimahty conditions for uniformly overtaking optimal control on 
infinite horizon in the free end case. In the papers of S.M. Aseev, A.V. Kryazhimskii, V.M. Veliov, K.O. Besov 
there was suggested the boundary condition for equations of the Pontryagin Maximum Principle. Each optimal 
process corresponds to a unique solution satisfying the boundary condition. Following A.Seierstad's idea, in 
this paper we prove a more general geometric variety of that boundary condition. We show that this condition 
is necessary for uniformly overtaking optimal control on infinite horizon in the free end case. A number of 
assumptions under which this condition selects a unique Lagrange multiplier is obtained. The results are 
, applicable to general non-stationary systems and the optimal objective value is not necessarily finite. Some 

examples are discussed. 
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■ Introduction 

The Pontryagin Maximum Principle for infinite horizon problems had already been formulated in the 
monograph [36]; the general Maximum Principle for infinite interval was proved in [28], but such Maximum 
Principle has no transversality condition, and in general, selects a too broad family of extremal trajectories. A 
significant number [28,6, 11, 30, 34,42,40, 13[ of such conditions was proposed; however, as it was noted in, for 
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CO ■ example, [28, 34, 41], [6, Sect. 6], [38, Example 10.2], these conditions, as pointed out in ]39], "may frequently fail 
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to hold (conditions securing these properties may fail.) Even if they do hold, for example when strong enough 
_ growth conditions hold, these condition may fail to give any information determining the integration constants 

arising when integrating the adjoint equation." 

Since the necessity of this condition does not imply its nontriviality on solutions of the relations of the 
■ Maximum Principle, it is reasonable to find a condition that would select a single solution of the relations of the 
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Maximum Principle for any optimal control. For this purpose, [38] proposes to find tp such that it is a pointwise 
limit of a sequence of shadow prices equal to zero on certain sequence t t oo of times. Under assumptions of [38, 
Theorem 6.1], such tp^ is unique; in what follows, it will be referred to as r-vanishing shadow price. 

In papers [4,5,6,7], Aseev and Kryazhimskii proposed the analytic expression for the shadow prices. This 
version of the normal form of the Maximum Principle holds with the explicitly specified shadow price. This gives 
a complete set of necessary optimality conditions (see [4,5,6,7,8,10]); moreover, under assumptions of [8,10,11, 
38], the solution of this form of the Maximum Principle is uniquely determined by the optimal control. 

This paper aims to merge these two approaches, to find assumptions such that a r-vanishing Lagrange 
multiplier of the Maximum Principle corresponds to every optimal control, and to express its shadow price 
explicitly in the form of an improper integral that depends only on optimal control and trajectory. 

In this paper, we consider only the problem with free right end. It is assumed a priori that an optimal control 
(uniformly weakly overtaking optimal control) exists (for discussion of existence, refer to, for example, [12, 14, 15, 
16,22]). In addition to this, all functions are assumed to be smooth in x. We also do not concern ourselves with 
sufficient optimality conditions (see, in this connection, for example, [14,37,40,44]). Papers [39], [6, §13] actually 
describe sufficient conditions of optimality for same shadow price under sufficiently strong growth conditions. 

The structure of the paper is as follows: We begin with formulating the general control problem and 
stating general notation and main assumptions (Section 1). Then, we formulate certain useful propositions 
from topology and stability theory (Section 2) which are later used mostly in proofs; these propositions are 
proved in Appendix. After that we discuss the relations of the Maximum Principle and introduce the notion of 
T- vanishing Lagrange multipliers. Then we show that its existence is the necessary optimality condition (Theorem 
2). Connection between r-vanishing Lagrange multiplier and degenerate problems is investigated in Subsection 
4.2; for information on the connection with the condition i''^{t) — > refer to Subsection 4.1. The problems with 
monotonic right-hand side are investigated in Subsection 4.3. Section 5 is mainly aimed at obtaining the most 
diverse sets of conditions under which a r-vanishing shadow price can be explicitly expressed via a Cauchy-type 
formula. Here we also discuss connections with the results of [6,8,10,38]. 

The last section is completely devoted to analysis of examples. We show how the choice of a sequence of r 
from a number of uniformly weakly optimal solutions selects what is needed most with the help of r-vanishing 
shadow price (Example 2). Example 3 demonstrates that finding the r-vanishing Lagrange multiplier allows to 
solve abnormal problems in almost the same way as normal problems are solved. Example 4 shows how hard it 
is to determine a r-vanishing Lagrange multiplier in cyclic problems even if we know that the optimal control is 
unique. In Example 5, the search for an optimal solution is reduced to a boundary value problem. 

A part of results of this paper was announced in [31], [32]. 



1 Preliminaries 

We consider the time interval T = M>o. The phase space of the control system is the finite-dimensional metric 
space X = M™; denote the unit ball in X by D. Denote by L the linear space of all real mx m matrices; equip L 



with the operator norm. The symbol E (which may be equipped with some indices) denotes various auxiUary 
finite-dimensional Euclidean spaces. 

For a subset A of a topological space, denote by d A the closure of A, and by int A the interior of A. 

Slightly simplifying the notation when passing from the sequence r = (rn)„gN to its subsequence r', we will 
plainly write "subsequence r' C r" 

Let C{T, E) and CiodT, E) be topological spaces of all continuous functions of T to E. Let us equip the first 
one with extended norm || • of uniform convergence. The second one is equipped the compact-open topology. 

Here and below, for each integrable function a of time, the integral Jg°° a{t)dt is the limit a{t)dt as 
T oo. An improper integral, for example, over [T, oo), is interpreted in the same sense. 

Let us also consider a finite-dimensional Euclidean space U and map U of T to set of all subset of U. The 
set ii of admissible controls is understood as the set of all Borel measurable locally bounded selectors of the 
multi-valued map U. The topology on Si is defined through the inclusion il C ^(^^^(T, U). 

A function a : T x £i x U — >■ £2 is said to 

1) satisfy the Caratheodory conditions if a) the function a{-,x,u) : T ^ is Borel measurable for all {x,u) € 
El X U, b) the function a(t, •, ■) : _Ei x U — ^ £2 is continuous for a. a. i G T. 

2) be locally Lipshitz continuous if for each compact subset K oi Ei xV there exists a function G Lj^^T^T) 
satisfying \\a{t,x,u) — a{t,y,u)\\E2 < Lf^{t)\\x — uWei for all {x,u), {y,u) e K, t eT. 

3) be integrally bounded (on each compact subset) if for each compact subset if of £1 x U there exists a function 

e Lj^dT,T) satisfying \\ait,x,u)\\E" < M%;{t) for all {x,u) G if, i G T. 

We assume the following conditions hold: 

Condition (u) : Z7 is a compact-valued map, and its graph is Borel set. 

Condition (fg) : Locally Lipshitz continuous on x Caratheodory functions / : TxXxU^X, g : TxXxU^ 
R, ^:TxXxlLJ— >L, ^:TxXxU^X are integrally bounded (on each compact subset); in addition, / 
satisfies the sublinear growth condition (see, for example, [45, 1.4.4]). 

Let us consider the control system 

x = f{t,x,u), x{Q) = x**, t eT, X eX, u{t) € U(t), (la) 

where a;** G X is an initial value. Now we can assign the solution of (la) to each it G il. The solution is unique 
and it can be extended to the whole T. Let us denote it by a;". The map « i-> a;" of it to C;oc(T, X) is continuous 
[45]. 

In what follows, we study the problem of maximizing the objective integral functional 

J"(T) "^^"^ max; J"(T) = / a;"(t), w(t))dt. (lb) 

Jo 

If there is no limit in (16), the optimality may be defined in diverse ways (for details, see [14, 16,43,44]); generally, 
we will use the following definition: 

Definition 1 We say that a control w° G il is weakly uniformly overtaking optimal (see [15]) if 

limsupsup (J"(t) - r\t)) = 0. 



For every sequence t = (rn)neN t oo of times, we say that a control w° 6 il is r-optimal if 

limsupsup (J"(t„) - J"°(t„)) = 0. 

n—>-co ueiX 

We also assume: 

Condition (t) : there exists a weaJcly uniformly overtaking optimal control m° £ il for problem (lo)mS-(16). 
By this condition there exist an unbounded sequence t = (rn)neN £ T*^ and some sequence (7n)neN £ T*^, 
converging to zero, such that 

(r„) > J" (r„) - 7n Vm e il, n € N. (2) 

Then the control «o is r-optimal. Fix a sequence r. Also denote by the trajectory that corresponds to w° . 

Thus, any weaJcly uniformly overtaking optimal control is r-optimal for some sequence t 'I oo. Similarly, 
any uniformly overtaking [15,29] optimal control is r-optimal for every sequence r t oo. Since the definition of 
r-optimality refines these definitions, it is especially convenient if such sequence r is given initially. 



2 Auxiliary results 

2.1 The set ii of generalized controls 

For each u G U, the symbol S(u) denotes the probability measure concentrated at the point u. Denote by iln 
the family of all weakly measurable mappings r; of [0, n] to the set of Radon probability measures over U such 
that ri{U{t)) = 1 for a.a. t G [0, n]. Let us equip this set with the topology of *-weak convergence. Then, the 
obtained topological space is a compact [46, IV. 3. 11], and the set iXn = {w|[o,n] | m G 11} is everywhere densely 
included in iXn [46, IV.3.10] by the map u —¥ 5 ou. We also keep the notation = 5 o vP . 

Now, let us introduce the set of all maps 77 of T into the set of Radon probability measures over U such that 
'?l[o,n] £ ^ for every n G N, and let us denote it by il. For every n G N, let the projections TTn : il ^ iln be 
given by = J^licn] for all 77 G il. Let us equip iX with the weakest topology such that all projections are 

continuous. The set il is called the set of generalized controls. 

Let us assume that for the Euclidean space E, the function aiTxiSxU— >-i5isa locally Lipshitz continuous 
integrally bounded Caratheodory function that satisfies the extendability condition on T (for example, if the 
sublinear growth condition holds; see [45, 1.4.3]). 

Let us fix a set H C £' of initial values and the system for w G il: 

il = a{t,y{t),u{t)), y{Q)=ieE:, tGT,wGil. (3a) 

It can also be generalized for 77 G il: 

y= I a{t,y{t),u)dri{t), y{0)€S, iGT,r;Gil. (3b) 
Ju{t) 

Each its local solution can be extended onto the whole T. For every 77 G il, let us denote the family of all 
solutions y G CiocC^jE) of system (36) by ^[r}]. Such transition from a system defined for u G il (like (3a)) 
to a generalized system, which is defined for 77 G il (like (36)), will be done sufficiently often; to avoid writing 



the generalized relation, we will write the initial one with the sign For example, we will write (3a) instead 
of (36). In particular, for a solution € C;oc(T,X) of the Cauchy problem (la), the function T J^{T) could 
by introduced, for every 77 € il, by the rule (16). 

Proposition 1 Assume (u). Then, 

1) the space ii is a compact, and 5(il) is everywhere dense in it; 

2) the map 21 : iX — >■ CigcC^, E) is continuous and %[5 o il] is everywhere dense in a compact 2l[il] C Cigci^i E) 
for any compact S C E; 

3) If (fg.) holds, then the map rj^ ofiX to C(oc(T,X) and the map r] ofU to C;oc(T,]R) are continuous. 

Since the proof of this proposition only plays an auxiliary role, it was repositioned to Appendix. Let us also 
note that embedding of the initial space il of admissible controls into a space with a more convenient topology 
is a well-known trick; see, for example, [27,46], and [15,19,21], [6, Sect. 8] for infinite horizon problems. A weak 
compactness was used, for example, in [12,16,22,33]. 

2.2 Stability and thin tubes of solutions 

Let w : T X U — ^ T be an integrally bounded (on each compact subset) Caratheodory map. For all r e T and 
T] € il, let us introduce 

2wM{t)= [ [ w{t,u) drj{t) dt. 
Jo Ju(t) 

Let us assume that £,w = 0, and for every 77 e H from 2,w [??] (t) = for all r € T it follows that 77 equals 
a.e. on [0, t]. The set of such w is denoted by {Null){u^). 

For every position (1?*, j/*) € T x there exists a unique solution y € C(T, E) of the equation 

y = a{t,y{t),u°it)), y(r)=j/*. (3c) 

The solution continuously depends on (i9*,y*). Let us denote its initial position y{0) by >c{'0*,y*). 

Proposition 2 Let U be a compact-valued map, and its graph is Borel set. Let S be a compact subset of E. 

Then, there exists w° € {Null){u'^) such that for arbitrary 77 £ il, T € T for every solution y of (36) from 
h{^, y{^)) G E for all -& e [0, T] it follows that 

\\yi(i},ym - 3/(0) IIb < i:^o[77](^) Vt? g [0,T]. 

In the geometric sense, this proposition means that if a solution 2/][o,t] from the funnel 21(77] does not escape the 
area 21[m''], then it also does not escape the tube of of solutions of (3c), breadth of which (at t = 0) does not 
surpass il^o[77](T). See the proof in Appendix. 



3 T-vanishing Lagrange multiplier as a necessary condition 



3.1 The core relations of the Mcuximum Principle 

In what follows, we consider the shadow price ip a covector (a row vector); however, we will still write a; € X, ■)/) € X 
and will not distinguish between the space X and its conjugate space in the sense of sets. 
Let the Hamilton-Pontryagin function lK:XxTxUxTxX— >-Kbe given by 

Ji{x,t,u,X,tp) = tpf(t,x,u) + Xg(t,x,uj. 

Let us introduce the relations and boundary condition: 

x{t) = f{t,x{t),u{t)); (4a) 

m = —g^{x{t),t,u{t)A,m); (4b) 

sup J{(x{t),t,p,X,ilj{t)) = J{{x{t),t,u{t),\,ijj{t)); (4c) 

peu(t) 

x{0) = x**, ||V'(0)||x + A = 1. (5a) 

It is easily seen that, for each u G 11 for each initial condition, system (4a)-(4b) has a local solution, and each 
solution of these relations can be extended to the whole T. Lot us denote by 2) the family of all solutions 
{x,u, A, V) e C;oc(Tr,X) X ii X [0, 1] X Qoc(T,X) of system (4a)-(46),(5a) on T. Let us denote by 3 the set of 
solutions from 2) such that (4c) also holds a.e. on T. 

Let us embed the sets 2) and 3 into Cio(.{T, X) x 11 x [0, 1] x Qo^CT, X) by the mapping {Id, d, Id, Id) ; denote 
closures of their images by 2) and 3, respectively; then, 2) and 3 are compacts. 

By Proposition 1, for every (a;, r], A, ip) € 2), the following relations hold: (5a), (4a)-(46); for [x, ij, A, ip) € 2), 
we also have (4c), i.e., 

sup Ji{x{t),t,p,\,ip{t)) = / :K{x{t),t,u,X,ip{t))dr]{t). (4c) 
peu{t) Ju(t) 

Moreover, Proposition 1 implies that all solutions of these equations depend on both controls « e il and initial 
conditions continuously on any compact. 

A nontrivial Lagrange multiplier {X,ip) £ [0, 1] x C;o£,(Tr,X) is called a Lagrange multiplier associated with 
(a;°,u°) if {x^,u^,X,ij^) is a solution of the core Maximum Principle, i.e. the system (4a)-(4c). It is convenient 
to denote by A the family of all Lagrange multipliers {X,ijj) € {0, 1} x CiocC^,^) associated with (a;°,u'') such 
that 

X = lor (A = and I IV'(O) I |x = 1). (5b) 

For each ^ € X, let us also define solutions x^ € C(T, X), £ C(T,L) of the following equations: 

x^{t)= fit,x^{t),u°{t)) x^iO) = x*^+^, (6a) 
Mt)= %it,x^it),u°{t))A^{t) ^5(0) = 1l. (6b) 



For every T € T, consider the covector 




Similarly, for each u € iX, let us introduce a matrix function and a covector function /" by the relations 
i"(t) = |{(t,x"(t),«(t))A«(t), A"(0) = 1l, (6c) 

r(T)= r ^{t,x"(t),uit))A''{t)dt VTeT. 
Jo '^■^ 

In addition, wc call x'', A'', ?/;'', the solutions of the corresponding "-equations, or, equivalently, the limits, 
uniform on compacts, of x", A", -0", /" as 5{u) rj in the *-weak topology of il. 

Expressing the solution of linear equation (46) through (6c) (or (66)), then any shadow price ijj has the form 

V;(T) = {ip{0) - XI{T))A-^{T) \fT € T; (6d) 

and we can reformulate the result of [28] in the following way: 

Theorem 1 Under conditions (u),(fg), for any T-optimal pair {x^,uP) € Cigc{1,lC) x il of problem (la)- 
(16), for some A° € [0,1], -0° € C(T,X), the core relations of the Maximum Principle (4a) -(5a) hold for 

(x°,«o,A°,V°), i-e., (x°,«o,A°,V°) e3. 

Moreover, up to a positive factor, for some I* e X, t* € X, one of the two following relations also holds: 

aO = 1, ij\T) = {h-Io{T))Ao\T) VTeT; (7a) 
A° = 0, V°(T)= i-*Ao\t) VTgT. (7b) 

The core relations of the Maximum Principle are incomplete, since (4a)-(5a) do not contain a condition 
on the right endpoint, or, which is actually equivalent, on 7* or t». The remaining part of the paper is mainly 
devoted to finding the additional relations at I* and u with the aid of r-vanishing Lagrange multiplier. 



3.2 Existence of r-vanishing multipliers 

System (4a)-(46) can be rewritten for w = m'' in the form 

m = -^ixit),t,u°it),\,xb{t)), (8a) 
xit) = f{t,xit),u°it)), (8b) 
A = 0. (8c) 

Definition 2 A nontrivial Lagrange multiplier {X^,ip^) associated with {x^,u^) is called r-vanishing if 
{ip^,x^,X^) is a pointwise limit of a sequence of solutions {ipn,Xn, Xn)ne7i of system (8o)-(8c) such that 
V'n(''n) = for every n € N, here r' C r. In this case, the shadow price tp^ is called r-vanishing as well. 

Geometrically, this property means that the tube of solutions of system (8a)-(8c), however thin (at the initial 
time), intersects with the hyperplane ■i/' = Ox at arbitrarily far time Tn- 

We claim that the existence of r-vanishing multipliers is a necessary optimality condition. The main work 
horse of this proof is the following asymptotic condition of optimality structurally similar to [6, Theorem 9.1], [8, 
Theorem 3]. 



Propositions Under conditions (u), (fg), (r), for each weight w € {Null){u'^), there exist a sequence 

(x", 77", A", V'")neN £ <ind a subsequence t' of t such that 

1) for some ,\° e 'b it is (x", r/", A", V'") ^ (a;°, A°, V°) the topology of Cioc{T,X) x H x 
[0, 1] xQ„,(T,X); 

2) \\2Ann\\c^0; 

3) K K) - r\r'n) ^ 0+; V"(r;) = for all n e N. 

The proof of this proposition was repositioned to Appendix. 

Note that from V"(0) = -i/)"(r4) A''" (r^) + V"(0)yl''" (0) ^ = ^ A"J''"(r4), wc have A"/''" (r^) ^ '(/-""(O). 

Let £ = X X X X T, S = 2D X + 2D) x [0, 1]. To system (46), (4a), (8c), let us assign the weight w by 
means of Propositions 2. Substituting this weight into Proposition 3, we obtain 

Remark 1 Under conditions (u),(fg),(r) there exist a sequence (x", 77", A", i/'")neN £ and a subsequence 
t' of T such that 

1) for some (x°, A°, V") e 3, it is (x", 77", A", V") -> (x°, A°, V") in the topology of Cioc{^,X) x H x 
[0,1] xC,„,(T,X); 

2) the graphs of functions (V'",a;",A") are contained within the thinning funnels of solutions of system (80)- 
(8c); i.e., for some sequence {5n)n&i ^ ■> \- 0, we have 

x(t,(V'",a;",A")(t)) € (V'°(0),x**,A°) + 5„P x 5„D x [-5„,5„] Vt € T,n eN; 

3) J''"(rA)- J-"(rA)^0+; 

4) A"7''"(r;) ^ V°(0); ^-"(7-4) = for ah n G N. 

Note that (A^jI/j") is nontrivial because it satisfies boundary condition (5o) as well as the multipliers (A",V'")- 
For every n G N, consider a solution (?/>«, Xn, A") of (8a)-(8c) with the initial conditions (V'n(0),a;n(0), An) = 
>^K,(V'"K),a;"(<),A")). Then Vn«) = Ox- Since {^n{Q),Xn{0),\n) € (V°(0), a;°(0), A°) + 5„D x 5„D x 
[—Sn,5n], i.e., (V'n(0),Xn(0), An) ^ (V)*^ (0) , a;° (0) , A°) , and because of the continuous dependency of solutions 
of (8a)-(8c), (A°,i/'°) is a r-vanishing Lagrange multiplier. 

Theorem 2 Assume that conditions (u),(fg),(T) hold. 

Then, there exists a r-vanishing Lagrange multiplier (X^jip^) € A, for example, constructed with a limit of 
sequences from Remark 1. 

Moreover, for every r-vanishing Lagrange multiplier (A°,V'°) G A, there exist a subsequence r' of r, a 
converging to Ox sequence (^")neN £ X*^; o, converging to A° sequence (A")„gN £ (0, 1]^ such that 

ilP{0) = lim A"J.n(r4); (9a) 

n— >-oo 

V>°(r)= lim A"(/e(^«)-^«"(r))V(T) (9b) 

= lim r^it,x^nit),u''{t))A^nit)dtAo\T). (9c) 

and all the limits are uniform on every compact. 

If, in addition to that, A° > 0, then we cdfi cissuTne Xn — A — 1. 



Proof. The existence of a T-vanishing Lagrange multipher (A'', ip^) is shown above. By multiplying this nontrivial 
(a",'!/'") by a certain scalar, we can always provide condition (5o); thus, (A°, V'") € A. 

Let (a", V'") be a r-vanishing Lagrange multiplier. The sequences t', {\n)nen^ (V'n)neN exist by the definition 
of a r-vanishing Lagrange multiplier if we define C = Xn{Q) - x°(0) for every n e N. Since for all n € N 
%l)n{Tn) = Ox, the Cauchy formula (6d) implies Vn(T) = A"(/jn (r^) - /jn (T))^^„^(T) for every T e T, we have 
■0„(O) = X^{I^n{Tn) - I(n{T)) = A"/jn(r4). Now, Uniformity of the limit V° of Vn yields (9o). Substituting 
this into (6d) we obtain (9c) for every T e T. What remains follows from the theorem of continuous dependence 
of solutions on initial conditions, applied to (8o)-(8c) and (66). □ 



3.3 On different topologies for the set of generalized controls 

Consider a weight € {Null){u^). Define by the rule w^(t,u) = w^{t,u) + \ \u — u^{t)\\ for every {t,u) € 
T X U. Then, for a subsequence {un)nefi G ^^"^ from ||£^„i[(5om„]||c' — ^ it follows that \\un — 'M°||£1(t,u) ~^ 
(certainly, this does not imply that G L^{T,\])). Similarly, for any p G (0, oo),:^ G -Bioc(T, K>o), replacing 
||w — 'U°(t)l| with i^(t)||u — w''(/:)|P guarantees the convergence of ttn — — > in the topology of Lf,{T, U). For 
every interval T C T, this extended metric also induces the extended distance ^(r?, w°;£S(T, U)) on iX by the 
rule 

e{v,u°;LPi%V)) = ( [ Kt) / \\u-u''it)\\Pdn{t)dty^%ri€ii. 

^J-S JU{t) ' 

Addition of the summand v{()I^{t^u) (see (326)) provides the uniform convergence ||y(t) — 
o(t,2/(t),M°(t))||£P(T,x) by all 7? G ii, y G 2l[7?] such that 2/(0) G S. 

Let us replace the weight w from Proposition 3 and Remark 1 by stronger ones if necessary. Then there 
exists a r-vanishing Lagrange multiplier (A", as the limit of sequences from Remark 1. Now we have 

Remark 2 Assume that conditions (u),(fg),(r) hold. Then there exists a r-vanishing multiplier (A'', ?/>'') 
associated with (a:°,w°) such that for this multiplier, the conclusion of Remark 1 holds and, moreover, the 
following convergences are guaranteed: g(77",M°;£f!(T,lLJ)) — >■ 0, ||a;"(i) — /(i:a^"(0''"°(*))ll££(T,x) ~^ Ox- 

The condition (u) implies that, a.a. t G T, the controls are chosen from the compact t/(t). Let us weaken 
this assumption to the following: 

Condition (uo-) : Z7 is a closed-valued map, and its graph is Borel set. 

We shall still assume the conditions (fg), (r) to hold. A nondecreasing sequence (J7^'"^)rgN of locally bounded 
compact-valued maps is given by 

?/('■)(*) = {« G U{t) I ||m - w°(i)|| < r} G N,r G N. 

Let the set il^'"^ be the set of all Borel measurable selectors of the multi-valued map Then for all r G N 

M° G il^'^' C and U = yJrmU^'"'^ hold; now, we have 11^°°' = U^gNH^'') = il. 

Repeating the reasonings of Sect 2, for every r G N U {oo}, we can construct sets ii^'"^ and images = 
7rn(ii^'"^),i4r'' = 7fn(il^'"^). Denote by iX the set of all maps r] from T into the set of Radon probability measures 



over U such that ^|[o,n] 

€ i4°°^ for every n € N. The topology of this set is the weakest topology in which il^'^^ 
could be continuously embedded into il. Note that under our definition, u° € 5{ii'-''^) C 5{iL) for all r e N. 

To system (46),(4o),(8c), let us assign the weight w by means of Propositions 2. Note that this weight 
is independent of r. For the sequence r, for each we have Remark 1; in particular, there exist a time 

tr € T,tr > r, a, r- vanishing Lagrange multiplier (A'", V''^), and a solution (a;'", rf ,ilf ,\^) € 2) with the properties 

sup %{x{t),t,p,\'',i!^{t)) ='K{x{t),t,u°{t),\'',Tp'^{t))\l a.a.tei: (10a) 

peu(^){t) 

\\^w{rf)\\c < lA, - ^■nic([o,r],x) < 1A-, - V'nic([o,ri,x) < lA, (10b) 

\\H{tr,{V{tr)X{tr)X)) - (V°, X** , A°) 1 1 < l/v, (lOc) 

< J"" (tr) - r° {tr) < l/r, ^^tr) = Ox- (lOd) 

Passing to the limit, we obtain 77'" —¥ w° from ||£tu(77'")||c' < lA- Passing to the subsequence r' C (tr)reN C r, 
we can provide the monotonicity of tr and convergence of the sequence (A'", V''^)reN £ ((0,1] x C;oc(T,X))^ 
to certain {X^,ip^). Under these assumptions, we immediately see that {ip^,x^,X^) is the solution of (8o)-(8c) 
that satisfies {5a). Now the sequence (x'", 77'", V''^, A'^)reN converges, by (106), to {x°,u°,X°,ip°). Passing to the 
pointwise limit in (lOo), we obtain for (a;°, A", V'°) the property (4c). Thus we proved items 1) and 2) of 
Remark 1. Since the limit of (x*", ■0'", A'")r£N and {x^, rf , tp'^ , A'")reN is the same, items 3) and 4) follow from 
(10c) and (lOd) respectively. 

Consider again the solutions {tpn, Xn, X") of (8a)-(8c) for the initial conditions {'4>n{0),Xn{0),Xn) = 
^{tu, {''P^{Tn),x"'{rn), X^)). Then {X^,ip°) is a r-vanishing Lagrange multiplier and Theorem 2 holds under 
condition (uo-). Thus, 

Corollary 1 Condition (u) in Remark 1, Theorem 2 could be replaced with (uo-)- 

Corollary 2 Assume conditions (ucr),(fg) hold. Let a pair {x^,u^) € C;oc(T, X) x iX be weakly uniformly 
overtaking optimal for problem (lo)-(16). 

Then, for some unbounded sequence t = (rn)neN £ there exists a r-vanishing Lagrange multiplier 

(A°,V°)eA 

Corollary 3 Assume conditions (uo-), (fg) hold. Let a pair (a;°,-u°) G C(oc(T, X) x iX be uniformly overtaking 
optimal for problem (la) -(16). 

Then, for each unbounded sequence r = (Tn)neN £ T^j there exists a r-vanishing Lagrange multiplier 
{X°,i>°)€A. 



4 Properties of r-vanishing Lagrange multipliers 

4.1 On stable shadow prices 
Consider the boundary conditions 



lim V(t) = 0, (11a) 



liminf||V°(r„)||x = 0. (lib) 



Definition 3 The component ilP of a solution j/° = (■0°, a", A°) of system (8o)-(8c) is said to be Lyapunov 
stable in domain S if for each g > there exists 6 > such that for each solution y = {ip,x,\) of system 
(8o)-(8c) from ||j/(0) - J/°(0)||b < 6,y{0) € S it follows that \\'tp°{s) - ipis)\\x < e for all s € T. 

Corollary 4 Assume that conditions (uo-), (fg), (t) hold. Let for some solution {ip,x^,X) of system (8a)-(8c) 
the component ip be Lyapunov stable in the domain X x X x [0,1]. 

Then all r-vanishing multipliers {X^,ip^) € A satisfy the condition (11&)- 

Proof. Since equation (8a) is linear, the Lyapunov stability of -ip for some solution {^p, x^, A) of system (8a)-(8c) 
yields the Lyapunov stability of this component for all solutions of system (8o)-(8c). 

Consider every r-vanishing multiplier (A°, ip^) and the sequences t', (An)neN, ixn)neN-, (V'n)neN from its 
definition. Then, yn = {'4'n{0),Xn{0),Xn) — > J/" = {ip'^ (Q) , (0) , X^) , and by definition of Lyapunov stability for 
some N e N for al\ n e N,n > N \\ip°{Tn)\\x = - V'°(T"n)||x < £• Since e > was arbitrary, we have 

shown (116) for all r-vanishing multipliers. □ 

Note that since (46) is linear, the partial stability of the variable tp implies its boundedness. Therefore, the 
proved proposition is useless if all shadow prices are unbounded. Note that, as follows from [43, Example 5.1], 
for a weakly uniformly overtaking optimal control w", a (x°, w", A°, V'°) £ 3 that satisfies (116) may not satisfy 
stronger condition (11a). 

The stability condition can be replaced with a condition which is stronger but much easier to check. 

Corollary 5 Assume that conditions (uo-), (fg), (r) hold. If the functions L^,L^ are independent of the 
compact K, and these functions are summable onf (see [37, Hypotesis 3.1 (iv)]), then any r -vanishing multiplier 
satisfies condition (11a). 



Proof. Let (V'°,A°) be a r-vanishing multiplier. Let = (V'°(0),a;°(0), A°), S' = ^o+DxDx [-1,1]. By [37, 
(3.3)] there exists a summable function w € £^(T, T) such that xj){t) < (jo{t) for a.a. t € T for all solution (ip, x, A) 
of system (8o)-(8c) if C = {ip{0),x{0),X) € S. Now for each pair (ti,t2) €T,ti < t2, 



if ^ € H. For each e > there exists T € T such that the second summand does not exceed e/2 if ti > T; now 
there exists r € T such that \\4> — V'°llc([o,Tl,x) does not exceed e/2 if ||^ — ^°\\e < t. Then, setting t\ = t2, 
we obtain \\ip — < e if ||^i — ^2\\e < i-e., the component tp'^ is Lyapunov stable. By Corollary 4, (116) 

holds, and < e/2 for some ti e T,ti > T. 



Then, setting ^ = (V'°(0),x°(0),A°), we obtain ||V°(t2)||x = ||V'°(t2) - V°(ii)l|x + HV-^CiOllx < e if ^2 > ti. 



The even more strong conditions used for proving transversality condition (11a) can be seen, for example, 
in [50, (A3)] (the Lipshitz constants L|j., are required to decrease exponentially with time). 

4.2 Degenerate r-vanishing Lagrange multipliers 

Remark 3 Assume that conditions (uo-), (fg), (r) hold. If for some t' C r 




Thus (llo) holds. 



n 



limsup ||/j(r4)||x < oo 



(12) 



n—^oo,i—^Ox 



then the pair {x^,vP) is normal, there exists a r-vanishing multipher (1, £ ^• 

Moreover, if limsup ||^j(Tn)||x < oo, then every r-vanishing multipher (A°, V*") € ^ satisfies A° = 1. 

n— )-c»,^— >0x 

On the other hand, if lim ll^f(T"n)||x = oo, then every r-vanishing multiplier (A'^,V'°) G ^ satisfies 

ra^cio,{->-Ox 

A° = 0. 

Proof. By Theorem 2 there exists a r-vanish multiplier (A", ip'^) G A satisfying (9a), but for each such multiplier 
we have A"||/^Jr4)||x = ||^"(0)||x ^ ll^"(0)||x; then AO = iff (||J^„ (r;OI|x)«eN t (»• □ 
There are many conditions that provide nondegencracy of the problem; in connection with this, note papers 
[6, 8, f 0, f 1,38]. The connection between the normality of the problem and finiteness of Jo seems to be noted for 
the first time in [6, (3.24)]. Condition (12) develops this approach, actually demanding to be locally bounded. 
As we are going to show below, many sufficient conditions of nondegeneracy for the optimal problem can be 
obtained from (12). However, there are other ways to prove the nondegeneracy. For example, [6, Theorem 5.1] uses 
the smoothness of the objective value function, and [6, Theorem 10.1] and 18, Theorem 5] use the monotonicity 
of the functions / and g' in a; and the stationarity condition. 

Note that although the examples of abnormal problems are well known (J28,6,35]), additional relations of 
the Maximum Principle for such problems did not receive much attention from researchers; the author only 
knows of the dual problem construction in paper J35]. Let us apply Theorem 2 to these problems. 

Consider a degenerate r-vanishing solution (a;°, w°, 0, '0°) € 3- Then, from (5a) we have V'°(0) = 1, and 
Theorem 2 yields 

,0/px(9g) ^^"(0) ^ ■^»4„(o)(-r4) 4„(0)(t») 

^ ^ ll^°(0)||x ™ P„4„(o)(rA)||x ||4„(0)(rA)l|x ^ ' 

provided Xn{0) — > x°{0). Using Remark 3, we finally obtain 
Corollary 6 Let {ua),{fg), (r) hold. Let 

\im ||75(t„)||x = oo, lim ../^/^"s^, = u. 

7i->-oo,€->-0x n->-oo,i->-Ox \\^(^[Tn)\\x 

for some vector u € X. 

Then, there is unique r-vanishing multiplier (0,'!/'°) € A, and l* and are connected by (76). 



4.3 Monotonic case 

Consider a nonempty convex closed cone <L. The cone orderings ^, >- of X induced by C are the relations defined 
as follows: for all a;,j/ G X, 

{x ^£ y) {x — y € C), {x y) {x — y & int<t). 
The pre-orders on L defined as follows: for B,C £ L, 

{B C) {{B - c)x e (E yxedl), 

{B C) ^ {{B - C)x € int £ Va; € int £). 



Note that 1l Ol, 1l >-£ Ol- 

The conjugate cone of C is defined by C"*" = {a; e X | Vj/ € € xj/ > 0}. 

Proposition 4 Assume that conditions (ucr), (fg), (t) hold. Assume that there exists Carateodory function d : 
T X X — >• R such that for all x €lL and a. a. t £T the following relation holds: 

||(t,a;,w°(j)) Ol, ^{t,x,u°{t)) d{t,x)lj^. 

Then, there exists a r-vanishing multiplier (A", i/'") £ A, and for any such multiplier, we have ijP ^i!_± Ox, and 

V^°(o) e e:^. 

Moreover, if \^ > Q (for example, if (12) holds), then for all y € € 

limsup lM)y>ip°{Q)y>limIo{t)y>0, (14) 

*^-oo,5-)-0x 

and aii limits in (14) are correctly defined. 

If, in addition, there exists a Lebesgue point € T for the function such that 

^{e,x\e),u\t*)) ^^.Ol, 

then '!/'°|[o,t*] ^c-L Ox; in particular, '(/'^(O) e int£'^. If such Lebesgue point t* exists on every infinite interval, 
then ■!/'° >"£i 0. 

Proof. Fix arbitrary ^ G X, T > 0, > T. Denote by F^{t) the matrix || (f, X{(t), w°(f)), and by the 
measurable function t — d(t,a;g(t)); by condition, + mj(i)lL Ol- Now, let us consider a solution P(t) 
of the equation 

P = (F^it) + mj(i)lL)P, P{T) = 1l, t > T; 

then P(t) ^£ 1l for all t € (T, •&]. But the solution P is the product of two nonnegative solutions of the equations 
Q = F^{t)Q, Q{T) = 1l, and = m^{t)r^, r^(T) = 1. Thus, P(i?) = r^{S)Q{^) = r^{^)A^{S)A-^{T), and 
P(i?) :j=c: 1l implies ^5(i?)^J^(r) = Q(i?) = P(i?)/r5(i?) :j=c: ^iL/r^W for all > T. In particular, for all y € €, 
we have A^{'&)A'^^(T)y '^(^ y/r^{'&), whence 

^^5-i(T)y = ||(t,xj(t),n°(t))^^(t)^^-i(T)y>||(t,a:j(t),«°(t))^>0 (15) 

for aU ^ e X, y e C, T e T, t > T; thus, for T = 0, we have ^^^^ € C"^, hence the functions I^y, I^A^^{T)y are 

monotonic for all ^ £ X, T e T, j/ € C 

By Theorem 2, there exists a r-vanishing multiplier {ip^, A") € A. Moreover, each such multiplier {ip^, A°) € A 

satisfies formula (9c) for certain sequences A" and ^n- However, the integrand of (9c) lies in C"*". Passing to the 

limit as n — >■ oo, we obtain ijj^ ^j-j. Ox- 
Fix the basis of span€ made of the vectors y € £; now, for every such vector y, the functions I^y are 

monotonic, and 



(9a) ,0 

Ox 

we obtain the first estimate from (14) 



limsup XoIdt)y> lim Ao/t (t4)j/ = i'°iO)y; 

t-)-oo,€->-Ox 



Fix any T £ T, j/ € C Now, monotonicity of I^A^ ^{T)y yields 

V.°(T)3/^i^ lim A"(75„(r;)-75„(r))A^-i(r)y> lim X^^St) - I^^T))A-^^{T)y 

= A°(7o(t)-/o(T))^o-^(T)/>V^*||(^,cc°(tf),«°(^))^>0 W > T. (16) 

Substituting T = and passing to the limit as t — > oc, wc obtain the lower estimate from (14). 

If a'' > 0, and, in addition, there exists the Lcbesguc point t* with the required property, then for all points 
T < t* ,t > t* , sufficiently close to t* , integration on [T,t] yields ">" instead of ">" in the latter inequality of 
(16). Since by (15) this integrand is nonnegative for all t £ T, the same is true for all T < t* ,t > t* , whence we 
obtain ip°\[o^t'] Ox. 

Regarding the latter point, note that if we have ip{t) Ox for some t sT, then taking t* from (i, oo) yields 
a contradiction. □ 

Remark 4 For ip^ifi) yc 0, it is sufficient to find for each vector j/j from some basis of span£ Lebesgue point t* 
with the property ^{t*i,x°{t*),u°{t*))yi > 0. 

Let the right-hand side of the dynamics equation and the integrand of the objective functional be monotonic 
in X. This case frequently arises in economical applications, and monotonicity simplifies its analysis. It seems 
that the first to note the peculiarities of this case and to investigate it were Aseev, Kryazhimskii, and Taras'ev 
in their paper [9]. These were followed by papers [4,47]; the most general cases were considered in [6,8]. 

Fix the cone £ = l"!""^. in this case, = ff. Replace '^'^dimx, >-Tdimx with ^, >-. We obtain 

Corollary 7 Assume conditions (uo-), (fg), (t) hold. Assume that, for all x £ \ and for a. a. t £ T, the matrix 
^{t,x,u^{t)) IS a matrix with nonnegative off-diagonal entries, and ^{t,x,u^{t)) is a nonnegative covector, 
i.e., there exists a number d{t,x) G K such that the following relation holds: 

^{t,x,u°{t))^Qx, ^it,x,u°{t))^dit,x)l^. (17) 

Then, there exists a r-vanishing multiplier {\°,ip°) € A, and for every such multiplier we have iji'* )p Ox, and 

A° lim sup I.{t) ^ V°(0) ^ A° lim Io{t) ^ Ox (18) 

holds, and all limits in (18) are correctly defined and finite. 

If \^ > (for example, under (12) ) and there exists a Lebesgue point t* €T for the control m° such that 

^it\x^t*),u°it*))y(h., 

we have V'°l[o,f*] ^ Ox; in particular, i'°{0) y Ox- 

Remark 5 Assume that under conditions of Corollary 7 we can choose d{t, x) = 0, and the integral 

^^-{^,x°i'»),u°i'»))dS 
unboundedly increases as t — >^ oo; then, all r-vanishing solutions are degenerate. 



L 



9^ 



Indeed, under d{t,x) = 0, we can assume ro s 1; then, in the case A° > 0, (16) would, for T = 0, imply the 
boundedness of this integral. 

Note that in [9, Theorem 1], [6, Theorem 10.1], [8, Theorem 5] the estimate V' ^ Ox is made for problems 

/'OO 

X = f{x,u),u £ U,x{0) = xo, / e~''^ g{^x{t),u{t)^dt ^ max. (19) 

Jo 

The most general case is examined in [8, Theorem 5]; namely, a variant of Corollary 7 is stated: if (17) is 
satisfied for alH € T,u e U{t),x € X (see [8, (A8)]), then ip ^ Ox, and estimate (18) holds (see [8, (5.5)]); the 
conditions, under which ^ ;^ Ox holds in addition to the above, are also specified. The explicit form of estimate 
(18) under the very strong conditions on / and g is also specified in [47, (23)-(26)]. 

Let us also remark that in all papers mentioned, the nondegeneracy of the problem was not assumed (and was 
not directly reduced to inequality (12)), it had to be proved; for example in [8, Theorem 5], it is demonstrated 
with the aid of the stationarity condition from additional proposition [8, (A7)]: on any admissible trajectory, 
there are some {t,u), for which f{x{t),u) >- Ox- 



5 Explicit form of r-vanishing shadow price 

Previously, we examined two transversality conditions (11a) and (116); let us now consider the two conditions 

lim \\i;°{t)Ao{t)\\x = 0, (20a) 
liminf||V°(T„)Ao(T„)||x = 0. (20b) 

n—>oo 

Lemma 1 For each solution (x^ , , X'^ , ij^^) € 2), the transversality condition (206) holds ifftp^{Q) is a partial 
limit of the sequence (A°7o(Tn))ngN. 

Passing to the limit in A"/o(rn) = A°(/o(Tn) — /o(0)) = ip^{0)Ao(O) — ip'^{Tn)Ao{Tn), we obtain what was 
required; A° ^ by virtue of (5a). 

Lemma 2 If a nontrivial Lagrange multiplier associated with (x'^jU^) satisfies the transversality 

condition (206), then this multiplier is r-vanishing. 

Indeed, there exists t' C r, for which V°(Tn)^o(Tn) ->■ Ox. Then V°(0) - /o(Tn) = V'°(''"n)^o(Tn) ->■ Ox, and 
Io«) ^ V'°(0). Set Mt) = ihiO - Ioit))A-^it). Then Mrk) = Ox, V'°(0) - Vn(0) = V°(0) - Io{0 
tp^{Tn)Ao{Tn) Ox- The proof is completed by virtue of the uniform on each compact convergence ipn V'°- 



5.1 Uniformity in initial conditions. 

Theorem 3 Assume that conditions (uo-), (fg), (r) hold. Let one of the two conditions 

either 37* = lim I${Tn) £ X; (21a) 

n— >-oo,{— >-0x 

or3t*= lim eX, lim ||75(r„)||x = oo (21b) 

n->-oo,{->-Ox ||75(rn)||x Ti->-oo,{->-Ox 

hold. 



Then, there exists a r-vanishing multiplier (A", ip^) € A. Moreover, this multiplier satisfies for T € T the 
corresponding formula of 

A° = 1, ^°(T) = (/. - r ^{t,x°{t),u°{t))Ao{t)dt)Ao\Ty, (22a) 

J 

A°=0, ^°{T) = uAo\t). (22b) 
Corollary 8 Assume conditions (u<t), (fg), (t) hold. Let the limit 

lim mt)= r ^{t,x''{t),u°{t))Ao{t)dt 

t->cx>,C^Ox Jo OX 

be well-defined and finite. 

Then, the pair {x'^jU^) is normal and there exists a unique r-vanishing multiplier (A°,V''') G A. Moreover, 
for every solution (a;*^, A°, of core relations of the Maximum Principle (4a) -(4c) and {5b), the following 
conditions are equivalent: 

1) its Lagrange multiplier {X^,'^^) is r-vanishing; 

2) the transversality condition (206) holds; 

3) the transversality condition (20a) holds; 

^) A° = l, i,\T)= ^{t,x\t),u\t))Ao{t)dtAo\T) VT€T. (22c) 

Case (6) of Theorem 3 is shown in Corollary 6, case (a) will be proved below together with Proposition 5. 

In contrast with (a), case (6) expresses the r-vanishing Lagrange multiplier of a degenerate problem; the 
author has no knowledge of similar results. Together, these two cases allow to solve problem (la)-(16) through 
relations of the Majdmum Principle regardless of its degeneracy (see, for example. Example 3). 

The alternative (21a)=>(22a) vs (216)=>(22&) is sufficiently convenient. The need for existence of the limit 
as n — > oo in one of relations (21a), (216) can always be satisfied if we consider a subsequence. However, Example 
4 shows that a unique r-vanishing multiplier docs not necessarily satisfy (206), even for normal problems. 

Then, the limit in (21a) (or (216)) should exist not only for ^ = Ox, but also as ^ — > Ox. In some cases it is 
provided outright, for example, if the functions / and g are linear by x (see Example 3), or (see Example 5) by 
the following remark: 

Corollary 9 Assumptions of Theorem 3 hold for a subsequence t' C t if one of the assumptions either the 
functions f, g are linear with respect to x, 

or lim (4(r„) - /o(r„)) = Ox, 
n->-oo,^-^Ox 

,. I^iTn) - Io{Tn) _ 

or hm |,, . s.| = Ox, 

n-^x,i-^Ox ||/o(-rn)||x 

is satisfied. 

Let us finish the proof of Theorem 3. Substituting T = into (22a) yields 7* = V'°(0); then, Lemma 1 
implies 



Lemma 3 A solution {x^,ip^) o/(4a)-(46) given by formula (22a) satisfies (206) iff I* is a partial limit of the 
sequence {X°Io{Tn))neJi, 

Proposition 5 Assume conditions (uo-), (fg), (t) hold. Let the map Iq be bounded and let 

lim ||75-/o||c=0. 

Then, the pair (a;°, w°) is normal and 

1) there exists a r-vanishing multiplier {l,tp^) € A such that transversality condition (206) holds; 

2) a Lagrange multiplier {\^,ip^) associated with (a;°,M°) is r-vanishing iff the transversality condition (206) 
holds. 

3) a limit point 7* G X of the sequence (/o(Tn))neN corresponds to each r-vanishing multiplier (A°, e A, and 
a r-vanishing multiplier (A°,i/;°) e A corresponds to each limit point /* e X o/ the sequence {Io{Tn))neN- 
This bijection is given by (22a). 

Proof. By Theorem 2, a r-vanishing multipher exists; by Remark 3, any r-vanishing multiplier {X^,ijj^) satisfies 
A > 0; moreover, by (56), if (A°, ip°) € A, then A° = 1. Now, by (9o), we have 

V°(0)= lim A"7jJr;) = A° lim 75(r;) = A°7*, 

and from Lemmas 1 and 3, we obtain (206) and (22a). The inverse is true by virtue of Lemma 2. □ 



5.2 Uniformity by control 

Formulations of the preceding section can be expressed in another form. By varying, instead of the initial point ^, 
the control u near u^, we pass from x^, A^, 7^ to x", A", I". 

Fix pair (p, i^) £ (0, oo) x 7?(og(T, ]R>o). As in Remark 3, we have 

Corollary 10 Assume conditions (u), (fg), (r). If for the control and some subsequence r' C r we have 

) dt\\ < 00, 



limsup II r" ^{t,x''{t),uit))A''{t), 

ra->-oo,e('7,«°;ZS([0,r4],U))^0 " 



then the pair {x ,u ) is normal; there exists a r-vanishing multiplier (l,-)/)) G A. 

Proof. By Remark 2, there exist a r'-vanishing multiplier {}P and sequences r" C r', (x", 77", A", ■!/'")neN 
such that Remark 1 and e(7?",w°;£S(T,U)) hold. Then, £>(j7", m°; £^^([0,t"],U)) ^ 0; therefore, 
(7''"(r/i))„gN is bounded by the assumption of the corollary. But A"7''"(r4') — >• V'°(0), thus A° > 0. Now 
(l,i/'°/A°) is a r-vanishing multiplier. □ 

Corollary 11 Assume conditions (u), (fg), (r) hold. Let Iq be bounded and let 

ll^o-/''||c([o,r„],x) ^0 as n^oo,^(7?,K°;2P([0,T„],U) ^0. 

Then, the pair {x^,uP) is normal, and 



1) a T-vanishing multiplier e A corresponds to each partial limit /* € X o/ the sequence {Io{Tn))neJi 
formula (22a); 

2) all such multipliers satisfy transversality condition (206). 

Proof. Let /* be the hmit of {Io{Tn))neN for certain r' C r. Then, by Corollary 10, there exists a r'-vanishing 
multiplier (l,i/)°) such that i'^{Q) = lim (r^') for some r" C t'. By the assumption of the corollary 
this, limit corresponds with 7», i.e., ip'^{0) = A°7*. But this, by Lemma 1, is equivalent to (206). Substituting 
^O(O) = \°h into (6d), we obtain (22a). □ 
Repeating the proof of Corollary 10, but, this time, using (13), we have 

Corollary 12 Assume conditions (u), (fg), (t) hold. Let for some t* € X there be 



ll-'"''llc([0,r„],x) oo as n ->• 00,^(77, w°;£S([0,r„],U) ->■ 0. 



ii/''(^«)ii 

Then, for the pair (a;°, m°), there exists a degenerate T-vanishing multiplier (0, such that condition (206) 
and formula (226) hold. 

5.3 Conditions guaranteeing convergence to /*. 

Let us consider the conditions on the system that are both sufficiently easy to check and sufficient to make use 
of Corollary 8. 

Proposition 6 Assume conditions (uo-), (fg), (t) hold. For certain measurable functions F € £;\,g(T,L), G € 
Llg^{T,X), a summable function u) € 2^{T,T), let 

G{t))p^{t,x,u°{t)))p-G{t), F{t))p^it,x,u°{t)))p-F{t), (23a) 

\\G{t)B,{t)\\x<oj{t) (23b) 
for all {t, x) sT xX, where B* is a matrix solution of 

B*{t) = F{t)B*{t), B*(0) = 1l Va.a.t gT. (23c) 

Then, the result of Corollary 8 holds. 

Proof. For each B = (bij)^ jeTm ^ L, C = (ci)jg j-^ € X, let us introduce 

= iKlkjei:^ e L, C« ^ ilciDiei:^ e X. 

It is easy to see that ^ Ol, )p Ox, B^ )p B ^ -S", C" ^ C ^ -C". Moreover, C^s" )pCB^ -C'^B^ for 
all S e L, C € X. 

Denote by F^(t) the matrix ^{t,x^{t),u'^{t)) for all t € T. Now, for all ^ £ X, we have 
F{t) )p Fl{t) )p F^{t) ^ -F|(t) ^ -F{t) V a.a. t € T; 
comparing the right-hand sides and the initial conditions of equations (23c), (66), and equation 

B^t) = Flm^it), Bj(0) = 1l, 



for its solution by the comparison theorem, we obtain 



B*{t) >p B^{t) )p A^{t) -B^{t) ^ -B*{t) V a.a. t € T; 

in particular, B*(t) ^ A^^(t). Now, we have G{t)B*(t) ^ (|f (t, u°(i)))*^|(t) )^ (-^{(i))'. whence we 
obtain G{t)B^{t) ^ ^ -G{t)B^{t), ||4(t)||x < ||G(t)B*(t)||x < uj{t) for all $ € eoD, for almost all t € T. 
We have 



/•oo 

ll-^dlc < ll-f«llc([o,T],x) + 

/•oo 

|/€ - /ollc < \\k - -fo||c([o,Tl,x) + a;(t) 



dt, 
dt. 



For each e > 0, it is possible to find T e T, for which the second summands do not exceed e, and yet /j|[o,t] 
/o|[o,T] for ^ ~^ Ox- Then all conditions of Corollary 8 hold. □ 

Remark 6 The first condition of (23a) of Proposition 6 could be formally weakened down to 

F(t) + m(t)lL ^ ^{t,x,vP{t)) )p -F{t) - m(t)lL, 

for some summable function m £ £^(T,T). 

Indeed, consider a number R = e^o rn{0)de ^ Y, a. summable function wi = Jiw, and a matrix function 
Fx = F + mlL. Now, Bi{t) = e^^°-<^^ "''^^^'^^ B*{t) solves the equation Bi = FiBi,Bi{0) = 1l and 

\\G{t)Bi{t)\\x = e^[o.*i '"(^)'^^||G(i)B*(i)||x < e^[o>*i '"(^)'^^w(t) < Rujit) = iOi{t). 

Thus, under conditions of the remark, all propositions of Proposition 6 hold for Fi,uji in the place of F,uj. 

Note that conditions of Proposition 6 (taking into account Remark 6) for a smooth control problem without 
phase restrictions are weaker than conditions [38, (C1)-(C3)]. To be more precise, condition [38, (CI)] is exactly 
condition (u), and [38, (C2)] is exactly (236). Condition [38, (C3)] requires \\Git)B*{t)B~'^{e)\\x < w(t) for all 
t € T,9 € [0,t\, while condition (23a) requires this only for t e T, ^ = 0. In particular, in [6, Example 16.1], 
conditions of [6, Theorem 12.1] and Proposition 6 hold if p > 0, and conditions [38, (C1)-(C3)] only hold if 
p>l. 

Corollary 13 Assume conditions (u), (fg), (t) hold. For a summable function uj G £^(T, T) for all w e it, let 

||||(t,x"(t),«(t))A^(t)||^<u;(t). (24) 

Then, the pair [x^ ,u^) is normal and Corollary 8 holds with exception of uniqueness of the t -vanishing 
multipliers; specifically, 

1) exactly one t -vanishing multiplier satisfies (56) and (206); 

2) exactly one r-vanishing multiplier satisfies (56) and (20a); 

3) actually, it is the r-vanishing multiplier (1, ^ O'l^d this multiplier could be obtained by formula (22c). 



Proof. Note that (24) holds not only for all u € ii, but also for all rj € il; then, for all T e T, we have 

(24) fOO 

1 1 J" He < \\i^\\ciio,Tm+ ^{t)dt, 

(24) ro° 

||/"-/o||c < l|J"-^o||c([o,T],x) +2y^ ujit)dt. 

For each e > there exists a T e T such that the second summands do not exceed s/2. Let us construct 
the T-vanishing multiplier (A°,'^°) £ yl by a limit of sequences from Remark 1, but Proposition 1 implies 
I^\lo,T] ~^ Io\io,T] for V "u^- Hence, \\I^ — Io\\c and Iq is bounded. Since ip"{Tn) = Ox, we know that 
(206) holds for V°. 

From (24) for m = w'' we see that for any unboundedly increasing sequence of times v, the sequence 
iIo{vn))neN is fundamental and thus it has the limit point /*. Since this is correct for any unboundedly increasing 
sequence of times, loit) I* as t —¥ oo. Lemma 1 yields item 2). Finally, Lemma 3 implies (22c). □ 

The formula (22c) was obtained by Kryazhimskii and Aseev under easily checked assumptions on growth of 
functions f,g and their derivaties (see stationary case in [6, Theorem 12.1], [8, Theorem 4] and non-stationary 
case in [10, Theorem 1]). This condition generalizes (sec [6, Sect. 16], ]10]) a number of transversality conditions; 
in particular, it is more general than the conditions that were obtained for linear systems in ]11]. 

From conditions of ]7, Theorem 2],]6, Theorem 12.1], and [5, Theorem 1] it follows that for some a,/3 > 
and for all admissible controls tt € it, all trajectories x, and all fundamental matrices A, the following inequality 
holds: 

\\^{t,xit)Mt))\\\\Mm<fie-"' Vt€T (25) 

(see, for example, 16, (A5)-(A7)]). This is stronger than the conditions of Corollary 13. In paper JlO], it was 
actually assumed that (25) holds for x = x^, A = A^,u = if ^ is sufficiently small. This is slightly stronger 
than the stability condition in Corollary 8. However, it is worth noting that JIG, Theorem 1] uses a more general 
definition of optimality (the locally weakly overtaking optimality). In addition, condition (25) can be verified by 
calculating the characteristic Lyapunov exponents of the system of the Maximum Principle, see [6, Sect. 12], [7, 
Sect. 3],[10, Sect. 5]. 

Observe that (25) are characteristic of economic problems with exponentially decreasing discount factor; 
however, one could consider other non-subexponential discount factors (see [23,24,48,49]). Example 5 exhibits 
the solution of a problem with such discount factor. 

For economic problems with decreasing discount factor (specifically, for (19)) in ]8, Theorem 4], sufficiently 
broad conditions for applicability of formula (22c) were obtained. It turns out that it is sufficient to connect 
(see [8, (A4)] and (26)) the growth of 7" with the growth of J". In contrast with the results of ]10] or Corollary 
13, the finiteness of the optimal result on the optimal trajectory is required, and it is not guaranteed that 
the r-vanishing multiplier is unique. Let us transfer this result of ]8, Theorem 4] from case (19) to general 
non-stationary system (la)-(l&). 



Corollary 14 Assume conditions {u),{tg), (r) hold. Let there exist the finite limit lim J" (rn) . Let a functions 

n—^OD 

Wo, Woo € C(T,T) satisfy a;o(0) = 0, uJoo{Tn) as n oo. For all u € il from some £if,{T,V) -neighborhood 



Ov of the control for all fe, n e N, fc < n, let there be 

^{t,x^{t),u{t))A''{t)dt\\^ < uj^{n)+coo{\r{Tn) - r{Tk)\). (26) 

k 

Then, the pair {x^,u°) is normal, the limit I* = lim /°(Tn) e X is well-defined, and 

n—>oo 

1) exactly one multiplier satisfies (56) and (206); 

2) actually, it is the r-vanishing multiplier € A; and this multiplier could be obtained by formula (22c). 

Proof. There exists a sequence (sfe)fe£N i such that for all k,n €N,k < n, we have | J" (rn) — J" (Tk)] < Sfe- 
Substituting u = into (26) yields the existence of the finite limit I* = lim 7°(Tn). Now, as in the proof of 

n— >oo 

Corollary 13, we show that there exists the unique solution from 2) that satisfies (206) and that for it, accurately 
to a positive factor, the formula (22a) is correct. It only remains to prove that multiplier defined by (22a) is 
r-vanishing. 

By Theorem 2, for this problem there exists the T-vanishing multiplier (A°,V'°) € A that was constructed 
by the uniform limit of sequences (x", 77", A", V'")neN £ from Remark 1. Passing to the subsequence r' C r 

if necessary, we may assume ry" € clOf, for all n € N, then (26) hold for each r;". The function loq can be 
considered monotonic without loss of generality. Then, using the triangle inequality twice and, by the inequality 
J^" (rn) - J"" (rn) > 0, for all fc, n £ N, fe < n, we have the following: 

||7''"(r„) -7°(r„)||x - 117"" (r^) - 7°(rfe)||x£ 

117''" (r„) - 7''"(rfe)||x + ||7°(r„) - 7°(rfe)||x 
2a;oo(rfc) + a;o(|J"°(r„) - {Tk)\) + ojo{\K (tu) - ^(rfe)!) < 

2woo(-rfc) + wo(|J" (rn) - J" (rfc)|) + 

+ a;o(J''"(rn) - J"°(rn) + \K (rk) - J"°(rfe)| + |J"°(rn) - J"°(rfe)|) < 

2woo(rfc) + 2u!o{ll + {J"^ {rk) - J"" (Tfe)] + Sfe). 

Since 7", converges to Iq, J" uniformly on any compact and by definitions of ujq,uJoo and 7n, rn, Sk, passing 
to the limits first, as n — >■ 00, and then, as fe — >■ 00, we see that 

limsup||7''"(r„) -7°(r„)||x < 2woo(rfe) + 2wo(sfe) 

and 7''"(r„) - 7°(r„) Ox- Now, by Remark 1, we have A"7°(r„) ->■ V°(0). Since 7°(r„) ->■ 7*, we know that 
A° > and A°V°(0) = I* hold. By dividing this (A°, V°) on A°, we obtain (22o). □ 



6 Examples 

Example 1 The feature of [38, Ex. 10.2] lies in the fact that transversality condition (llo) fails to give any 
information that could help us in determining the unique Lagrange multiplier. Let us show that the definition 
of a r-vanishing multiplier allows us to do it. 

x = ux, x{Q) = l, u£[l/2,l], J"{T)= xe~'^*dt^^°° max. 

Jo 



Here, H = utpx + e~^*Aa; and ip = -uip - e~^*A. Then, A = x,I^ = J"; consider F = 1,G = 
e~^*,w(i) = e~*. By Proposition 6, there exists the unique r-vanishing multipUer. Substituting it into H, 
we obtain H{x°{t),t,u°{t), X° ,ip°{t)) = m°A°(J"''(oo) - J"°(t)) + e-2*Ax°(t); now, from (4c), we have w° = 1, 
J" (+oo) = 1; then, V°(0) = A° = 1, it is a unique r-vanishing multipher. (Of course, in this example, the 
control «° is easily found in view of the monotonicity of f,g and Corollary 7). 

The alternative (21o)=^>(22o) versus (216)=;>(226) allows us to effectively reduce an optimal problem to the 
boundary problem of relations of the Maximum Principle. The only obstacle is the uniformity of limits in (21o) 
and (216). In some cases, the uniformity of these limits is trivial, for example, when the functions / and g are 
linear by x. Thus, such problems are easy to solve. Let us demonstrate this by the following example: 

Example 2 

x = y, y = —x + u, x(0) = 1, j/(0) = 0, 1,1], / ydt max 

Jo 

Here, for all t, T, s G T, ^ G X, we have 

/ cos t sin t \ 
A^{t) = L/^Cr) = (cosT-l,sinT), 

\ — sin t cos t J 

Io{s)Aq^{T) = (cos(s - T) - cosT,sin(s - T) + sinT). 

Now, because is 27r-periodic, for any sequence (Tn)neN there exists a ? G [0, 27r] and subsequence r' C r 
such that /{(t^) ^o(?), whence, by Theorem 3, 

^°{T) = (7o(c) - Io{T))Aq\t) = (cos(c - T) - 1, sin(? - T)); 

m°(T) = org max (cos(? — T) — 1, sin(? — T))( ] = arg max sin(? — T)u, i.e. 

ue[-is] y^J «e[o,i] 

u°{T) = sgnsm{<;-T) V a.a. T G T. (27) 

Observe that the proposed approach finds, first of all, r-optimal controls. Indeed, let the sequence r be 
given. Express each Tn in the form Tn = 2-nkn + cr„, where On G [0, 27r). Substituting each limit point f of the 
sequence {(yn)n& into (22a) yields all corresponding r-vanishing multipliers; moreover, formula (27) yields all 
prospective r-optimal controls. 

It is easy to check (see [43]) that any control of form (27) is uniformly weakly overtaking optimal, thus each 
of them is r-optimal for its sequence r. 

Also observe that this example specifies why it is impossible to replace transversality condition (206) in 
Proposition 5 with the stronger one (20a). 

Example 3 Theorem 3 allows, in some circumstances, to find optimal solutions for degenerate problems in the 
way it is done for nondegenerate. Let us show this. Consider the modification of the well-known Halkin's example 
[28] (see also [35, Ex. 5.1], [9, Ex. 1]) 

i-T 



(0) = 1, / (1 - dt max, u G [a, j3] {a< j3). 

Jo 



Let there exist a weakly uniformly overtaking optimal control in this problem, then, for some sequence t, this 
control is T-optimal. 

Here, A^{T) = x°{T) and /^(T) = J" (T). Passing, if necessary, from r to its subsequence, we face one of 
the three cases: 

A) J"°(r„) +00. Prom Theorem 3(b) t* = 1, A = 0, H{T) = u°, u° = j3; if we substitute this into 
J"° (T), we will obtain < ^ < 1. 

B) J" (Tn) — ^ —00; similarly, we have = a > 1. 

C) J"°(t„) 7* e R. Here, by Theorem 3 (a), from (21a) follows (22a). Consider R{t) = I* - r° {t) - 
x^{t)ef\ Now we have H{t) = R{t)u - x, and u°{t) is defined by the sign of R{t). Since R{t) = -x{t) < 0, 
there is at most one switching point. 

Note that u{t) = 7 for all t > T, and for some T G T, 7 e [a, /?]. The boundedness of 7* — J" (t) provides 
that either 7 < or 7 = l.We claim that the sign of R{t) does not change. Assume the converse, and let 
there be a switching point T > 0; then, R{t) < for f > T, and u{t) =13 = 1, whence 7* = J^" {T), i.e., 
x{T) = -R{T) = 0, which is impossible. Hence, if 7?(0) > 0, then u° = = 7 < 0; else, it" = a = 7 = 1. 

Checking this, wc show that for a > 1 and u" = /3 for /? < 1 arc indeed r-optimal (moreover, 

even uniformly overtaking optimal) control in this problem. Consequentially, the problem has no r-optimal 
(and, therefore, no weakly uniformly overtaking optimal) control if a < 1 < /3. On the other hand, in case 
[q,/3] = [0,1], the control it" = is decision horizon optimal (DH-optimal, see [14]). Therefore, in Theorem 2, 
we could not replace the r-optimality (weakly uniformly overtaking optimality, uniformly overtaking optimality) 
with the 7)77-optimality (weekly agreeable, agreeable optimality; [14]). 

Example 4 Consider the Arnold's model from [2] 

fn di^) dt T-i-oo 

X = u, x[0) = a:»*, u € [1,2], x gR, — — — ~^ max, 

where profit density, denoted by g, is a scalar 1-periodic smooth function with a finite number of critical points. 
As shown in [3,20], this problem has a unique periodic optimal solution m", and for certain € T, we have 

{g{x°{t))<g.)^{u°{t) = 2) {g{x°{t)) > g*) ^ {u°{t) = I) fora.a.teT. (28) 

Denote the period of this solution by Tq. 

Consider the sequence r = (nTo)„gN. Note that only the control u°is r-optimal for the problem 

X = u, x{0) = X** , u €: [1,2], a; G K, 

(29) 



J(T)= l\{x{t)) 
Jo 



dt ~-> max . 



Actually, it is possible to prove that this control is at most weakly uniformly overtaking and there are no other 
weakly uniformly overtaking optimal controls in this problem. 

Application of Theorem 1 to problem (29) yields (28). Simple reflections on optimality show that 
niiiixe[o,i] 5(2^) < 9* < maxj-g [0,1] 5(2^)1 by (4c) we have A > for any Lagrange multiplier {\,tp) associated 



with (a;'', w°). However, no additional conditions on g* could be obtained from the core relations of the Maximum 
Principle. Let us see if it is possible to do that using the approach of this paper. 

It is obvious that = 1l. It is also easy to see that, using the substitution = x^{t),t = t?~^(a;°(t)), 
we could obtain for all T e T the following relation: 

Jo dx^ Jx0{0) 
now, if M° is constant on some interval (t2,il), then 



/o(ti) 



-h{t2)= r 



dg{i)) di) ^ g(x°(ti))-g(x°(t2)) 



If ti,t2 are switching points, then = (jr(a;°(t2)) = <?*, ^o(ii) = ^0(^2). Since w° is To-periodic, this 

immediately yields that the functions x^,gox^,I^ are also To-periodic. 

Observe that the t- vanishing multiplier (1,^/'°) € A exists. Let us show that it does not necessarily satisfy 
(206) and (22c). Since /q is To-periodic, /o(t„) = 7o(0), whence 7* = 0. If (22c) holds, then, for all T e T, we 
have ilP{T) = -Io{T). Substitution into the Hamiltonian yields JC(i,a;°(t),M, 1,V'°(*)) = -Io{t)u + g{x'^{t)). 
Now (4c) implies that u^{t) is determined by the sign of — /o(t), whence g* = g{x^{0)) = g{x**). But g* is 
independent of the choice of the initial point on the cycle in auxiliary problem (29). Therefore, for a.a. a;**, 
formula (22a) is invalid in this problem. This trivially implies that a T-vanishing control does not necessarily 
satisfy (206), even for normal problems. 

Is it possible to use the formula (22a) to find T-vanishing multipliers in this problem? Strange as it sounds, 

yes. 

Observe that the notion of r- vanishing multiplier, as well as the core relations of the Maximum Principle (see 
[1]), is invariant with respect to coordinate transformations. Let us maximize j"(T) = ln(l -|- J"(T)) instead 
of J"(T). Consider the problem 

x = u, x{0) = x**, y = g{x), y{0) = 1, u € [1,2], 

(30) 

J(T) = ln(l + J(T)) = \ny(T) = [ dt max. 

Jo yyt) 

_ / 1 

Take an arbitrary control u of form (28), and let its period be some To. It is easily seen that Af = I 

7,(nTo)= r^('-E^,-i^]('']dt. 



Vd^) V dx ' y^{t) 



nT„ ^ 



■{kit)ydt)-kit)kit)'-kit))dt- 



lo vlit) 

ydt) t=o n{y^{To)-ydO))+ym ^ ^ Vj/j(To) - j/^(0) ' 

Now, the theorem of continuous dependence on initial conditions implies (21a). Thus, Theorem 3 also holds for 
problem (30) for each control vP of form (28), and its proper r- vanishing Lagrange multiplier is given by formula 



(22a). Thus, formula (22a), under proper coordinate transformation, can be used to solve problem (29), (30), 
although this yields no additional conditions in comparison with the core relations of the Maximum Principle. 

Actually, this is rather reasonable since a control of form (28) is weakly uniformly overtaking optimal for 
the objective functional 

7(r) ^ ln(l + ln(l + Jim = £ y^'l'ly^ dt max . 

Therefore, in this problem, it has a r-vanishing multiplier; since the definition of r-vanishing multiplier is 
invariant, each control of form (28) has such a multiplier in problems (29) and (30) too even if the corresponding 
controls are not weakly uniformly overtaking optimal in these problems. 

Let us show the example of reducing an infinite horizon optimal control problem to the boundary problem. 

Example 5 In [10], the following stylized microeconomic problem was considered: 



x{t) = -vx{t) + u{t), x{Q) = Ko, u>0; 
J"(r)= re-''[eP\x{t)r-^{u{t)f] 



at max. 

Here, w(t) is the investment, z/ > is the depreciation rate, /sTq > is the given initial capital stock, e"*** is the 
discount factor (d > 0), e^* > is the (exogenous) factor of technological advancement (p > 0), hu^ii) (6 > 0) is 
the cost of investment w(t), and cr £ (0, 1] defines the production function. Under the assumption d-\-v> 53^1 
it is shown that there are no optimal solutions for p > d + f, and, for p < d + z/, each locally weakly overtaking 
control induces a solution of the boundary problem (see [10]). 

Consider the following objective functional: 

J«(T) = C g(t){x(t)y - h{t)\{u(t)fdt max. 
Jo ^ 



Here, h{t) is the discount factor, g{t) is the product of the discount factor and the factor of technological 
advancement. 

Suppose that there exists a weakly overtaking optimal control m°. Then, for some sequence r 00, this 
solution is r-optimal. Hence, there exists a r-vanishing multiplier {X^,ij;^) e A. 
Now, for all f € X, we have = e'"*, 

/j(r)= / g{t)axl-^{t)e-''^dt = a g{t)e-''*x''f\t) dt. 
Jo Jo 

Note that x^{t) — x^{t) = (,e~"^; now we have 

7j(r) - 7o(r) = cr^^ff(i)e-"''*[(x°(t)e'^* + 0"-' - {x\t)e''*Y-^] dt. 

It is easy see that |(r + 0""^ -r^^^l < (2^^ - 2)\i\r''-'^ < (2^-'" -2)A'o|C|r''"^ if 2\£,\ < Kq < r. Since the 
function x^{t)e'^* is monotonically increasing, we obtain 



\k{T)-Io{T)\< 



rg{t)e-'\xy-'dt 
Jo 



{2^-2)Ko\i\ = \Io{t)\i2^-2)Ko\i\ 



for all T € T, 2|f| < Kq- Now, by Corollary 9, considering the subsequence if necessary, we have the conclusion 
of Theorem 3. 

We claim that (/o(''n))neN is bounded. Assume the converse; then, considering the subsequence if necessary, 
we come to (216) and (226), whence lim leiTn) = ±oo, now i* = ±1, A'' = and by (4c) we have 

5— !-0, n— >-oo 

u^{t) = arg max e^* Io{t){u — vx) = arg max Io{t)u = ±oo, 
MeK>o «eR>o 

which is impossible. This contradiction proves the boundedness of sequence (/o(T"n))neN- 

Now there exists a finite limit /* of (/o(TH))neN for some t' C r. By Theorem 3, we have (22o), A° = 

l,V°(T) = (7*-7o(t))e''*, 

w(t) = arg max e^^I* - Io{t)){-i'x + u) + g{t){x°{t))'' - h{t)^u'^ = 

b c^^ 

arg max e''*(7* - Io{t))u - h(t)-u^ = , , , . (h - Io(t)) fora.a.t £ T. 
MeR>o 2 on,(t) 

Consider I{t) = I* — Io{t); differentiating I{t) with respect to t, we finally close (4a)-(46) into the boundary 
problem 

i;0 = -„x" + -^I, x°{Q) = Ko, (31a) 
7 = -ag{t)e-''\x°r-\ (31b) 
I{Tn) — >■ as n — > oo. (31c) 

Each r'-optimal control generates the unique solution of this problem. For u = 1 if such solution exists then 
there exists a finite limit lim / e~"*g(t)dt for some t" C r'. 

Note that to construct this boundary problem we have to know the subsequence r' C r. In terms of the initial 
sequence r, it is only possible to claim that, for a solution {x^, I) of problem (31a)-(316), Ox is the partial limit 
of the sequence {I{Tn))nevi- If for some functions g, h for some sequence t t oo there are multiple r-solutions, 
then each of them has its own 7 and subsequence t'. Also note that if we do not know the sequence t, then 
to find a weakly uniformly overtaking optimal control, we have to solve problem (31a)-(316) for the boundary 
condition 

liminf 7(t) < < limsup7(t). 

t->-oo 

Now suppose that g{t) > 0, h{t) > for a.a. t €T. Then, there exists the common limit 7* of all sequences 
(7o(Tn))neNi and for each weakly overtaking optimal control there exists the unique solution of problem 
(31a)-(316) for the boundary condition 

I{t) ^- +0 as i oo. (31d) 

It is possible to find the explicit solution of boundary problem (31a),(316),(31d) in some specific cases. For 
example, let the discount factor equal -^-^plyjTa, let the factor of technological advancement be equal to 1. For 

= ''^^^ = (1+^4/3 '" = = = = ^ 

we have 

x°it)={i+tr/^ «°(t) = |(i+*)V3, ,(,)^_^^ r\t) = {i+tr/^ 



The discount factor g{t) = f^-^^_^_\y/3 here is not arbitrary, its power a = 3,96/2,94 « 4/3 was determined 
by means of statistic analysis in [48]. A thorough discussion of various discount functions and their properties 
could be found, for example, in [23,24,49]. These papers do not generally assume the discount function to be 
dominated by a decreasing exponential function and do not assume its monotonicity. 

7 Appendix 

The proof of Proposition 1. For the sake of brevity, let us denote 11 = HneN^' ^^'^ ^® equip it with 
Tikhonov topology. Let A : ii —i- n he given by A(r)) = {^n{Tf)) for all 77 € il. It is a homeomorphism by 
continuity of the maps TTn and TTn ° 

Let n,k €N,{n > k). Then, the space iln is included in ilfc by the mapping 7r^(?7) = ??|[o,fc] for all r] € On- 
By TTfe ° 7ff = tF" for all n,k,i € N, {n > k > i), we have the projective sequence of the topological spaces 
{iXn,7ffc}; and we can define the inverse limit [26, III. 1.5], [25, 2.5.1]. In our notation, we can write it in the form 
^mjilrt, TT^} = A(ii) C n. As shown above, Z\ is a homeomorphism; hence, ii is homeomorphous to A{iL). Now, 
by Kurosh Theorem [26, III. 1.13], the inverse limit A(iX) of compacts iln is compact, and iX is a compact too. 
Similarly, from [25, 4.2.5] and [46, IV.3.11j it follows that ii is also metrizable. 

Repeating the reasonings without ~ or referring to [25, 3.4.11] and [25, 2.5.6] yields il = limjitn, tt^ } = 
A{il) C n. 

For each n £ N, let the mapping en : iXn — > iln be given by en{u){t) = {Sou){t) = (5„(() for all t G [0, n], w € 
iln- Since for all n, € N, n > fc it holds that ej. o tt" = Cn, we have the projective system {cn, tt]!}. Passing to 
the inverse limit, we obtain the mapping e/^ : — > A{U); from e™ o 7r„ = nn o S we have e/^ o A = A o 5, 
and from iln = cl en(iln) ([46]) we have A(U.) = cl e/i(/i(il)) = cl{Ao 5)(it); now, by continuity of A~^ , we 
obtain il= cl 5(ii). 

The mapping 2l[r;] is continuous by virtue of, for example, [45, Theorem 3.5.6]; the set 2t[77](it) is compact 
as a continuous image of a compact. In what follows, is sufficient to use il = cl S{iX). 

Replacing a and the compact S with the mapping (/, g) and the compact {(x**, 0)}, we obtain the continuous 
dependence on rj for the maps (p"^ . □ 

The proof of Proposition 2. For all n € N, let us consider set 

Gn = { (t, y W) I Vt/ e 2l[w°] , t € [0, n] } ; 

by the theorem of continuous dependence of solutions on initial conditions this set is compact as a continuous 
image of a compact S. Therefore, on this set, the function a{t, y, u^{t)) is Lipshitz continuous with respect to y 
for the certain Lipshitz constant Ln = L^^ € Ll„^{T,T). For all t € [0,n], define M„(t) = LniT)dT. Note 
that this function is absolutely continuous and monotonically nondecreasing. 
Fix n e N; for alH € [n — 1, n), m € U, let us consider the number 

R{t,u)= sup \\a{t,y,u) - a{t,y,u°{t))\\ . 
yeGn 



Here, the norm is continuous with respect to y and m, and y assumes values from the compact set; now, for 
every w e U by [18, Theorem 3.7] the supremum reaches the maximum for the certain function ymax [u\ ^ 
L^{[n,n — l),Gn)- Hence, R(t,u) is measurable with respect to t for each m € U. 

Fix a t € [n — l,n); for each sufficiently small neighborhood T C U, by continuity of a{t, ■, ■) on compact 
Gn X clT, there exists a function w* € C(T, T) such that w*(0) = and 

I \\a{t,y,u') - a{t,y,u°{t))\\ - \\a{t,y,u") - a{t,y,u°{t))\\ j < w*(||w'-w"||) (32a) 

holds for every y € Gn,u',u" € T. Without loss of generality, assume R{t,u') < R{t,u"). Now, by 
definition, R(t,u') > ||o(t,j/,M') — o(t, j/, ti''(t)) 1 1, and, substituting y = ymax iu"){t) into (32o), we obtain 
< R{t,u") — R{t,u') < — w"||); i.e., R is continuous with respect to the variable u on each sufficiently 

small neighborhood T C U; therefore on U too. Thus, the function R : [n — l,n) x U — >^ T is a Caratheodory 
function. 

Let us note that by considering all n € N, we define the Caratheodory function 7? on the whole T x U. 
Moreover, by construction, R{t,vP{t)) = 0. Hence, it is correct to define uP £ [Null){vP) by the rule 

= ||M-M°(t)|| + e^''(*'j?(t,w) Vn € N,t e [n- l,n),w € U. (32b) 

Consider arbitrary n G N, i? G [0,n], and (i?, yi)i ('^' 2^2) G Gn- There exist solutions J/1,2/2 € 2t[w°] of 
equation (3c) , for the initial conditions yi (t?) = yl . Let us introduce functions 

r(0 = 2/1(0-2/2(0, l^+(t)=e^"(*)||r(t)||B Vte[0,n]. 

By Lipshitz continuity of the right-hand side of (3c) we obtain ||r(t)||B > — Lri(^)||f (OIIbi ^''I'i 

= 2Ln{t)Wl{t) + 2e2^"(*V(t)r(0 > 2Ln{t)Wl{t) - 2Ln{t)Wl{t) = 0. 

Thus, the function W+ is nondecreasing, and finally for all (i?,?/!), (i?,j/2) £ Gn we have 

\\x{d,yl) - H{^,ymE = W+{0) < W+{^) = e^"W||j/i* - 2/2*||e. (32c) 

Let us now consider rj Gil, y e 2l[r;], T G T such that x{-&,y{-&)) G S for all 1? G [0,r]. Fix arbitrary n G N 
and i?i,i?2 G [0,T] n [n - 1, n), i9i < i?2 there exists the solution y° G such that 2/°(7?i) = t/(i?i). By 

construction of Gn, we have (t,y(t)), (t,y°(t)) G Gn for all t G [i?i,i?2]. Let us also define 

r = y''{t)-yit), W^-(i) = e-^"(*)|Kt)|b yt€[^M 

Then W-{^i) = 0. Now, 

= 2e-^^"(*V(t)r(t) - 2Lnit)Wlit) = 

2e-2^''(*V(t)(y°(0-a(t,j/(t),u°(t)) + a(t,j/(0,M°(0)-yW)-2Ln(0W^-(i)< 

2g-2M„(t) 1 1^.(^)11^ f R{t,u)dv{t) + 2Ln{t)Wl{t)-2Lnit)Wl{t) < 
Ju{t) 

2e-^"«iy_(t) / Rit,u)dvit) < 2e-2^-WTy_(t)^5%[^. 
Juit) 



Since function W- is nonnegative, for a. a,, t € {t € [&i,'&2\ \ W-{t) ^ 0} we obtain 

dW-{t) ^ ^-2M^{t) d£^o[ri] (t) ^ ^-2M„(<?i) d£„,o[??] {t) 
dt ~ dt ~ dt 

This inequality is trivial for t € [i?i,i?2],i < sup{f € [&i,'&2\ \W-{t) = 0}; whence, integrating inequality in 
t € [i?i,t?2], we obtain 

But x(i?2,2/°(i?2)) = J/°(0) = = hence, we have 

|k(t52,2/(l?2))->^(l?l,J/(l?l))||iS = M^2,y°{^2)) - }<{^2,y{&2))\\E < 

e^-(''=^)||y°(^2)-J/(^2)||ij=e^^"(''^%_(^2) < 

e^^"(''^)-^^"(''^n£«.°W(^2)-£.oW(^i)). (32d) 

Fix arbitrary t € [0,r]. For each g > we can split interval [0,t) into the intervals of the form such 
that M„(i?") - M„(i?') < e and [&','&") C [n - l,n) for the certain nsN. But, (32rf) holds for every interval, 
i.e.. 

Summing for all intervals, by x{0,y{Q)) = t/(0) and by the triangle inequality, we obtain \\}<{t, y{t)) — y{0)\\E < 
e^'^£^o[77](t) for every t £ [0,T]. Arbitrariness of e > completes the proof of the Proposition 2. □ 

The proof of Proposition 3. For every n € N, let us consider the problem 

(Tn) - 'Yni^wivKrn) = / / g{t, x'^ {t),u)d'n{t)dt - jn^wMiTn) ^ raax . 
Jo Ju{t) 

Here, the functional is bounded from above by the number J" (rn) +7n, therefore, it has the supremum. Every 
summand continuously depends on 77, which covers the compact il; therefore, there is an optimal solution for 
this problem in iX; let us denote one of them by 77", and its trajectory by x". 
For every 7 e T let the function :K7:XxTxUxTxX-*-Mbe given by 

^{^(a;,^, M, A, V') = 'K{x,t,u,X,ip) — ^w{t,u). 

Then, by the Maximum Principle [17, Theorem 5.2.1], there exists (X^,ip"-) € (0,1] x C([0,n],X) such that 
relation (5a) and the transversality condition 'tp'^^Tn) = hold, and 

sup M^„(x"(t),t,p,A",V'"(t))= / Jiy„{x"{t),t,u,X^,nt))dv"{t), (33a) 
peuit) Ju{t) 

= - / ^{x^{t),t,u,\'',r{t))dr,^{t) 
Ju{t) 

also hold for a.a. t € [0, Tn] . 

Let us extend the (a;",/)". A",';/'") to [Tn,oo) by the generalized control w°|[.r„,oo)- Let us denote by 3" the 
set of {x,u,X,ip) that satisfy relations (5a), (4a)-(46) a. e. on T, satisfy relation (33a) a. e. on [0,Tn), and 
possess the property m°|[t-„,cio) = ^"l[rn,oo)- Now we have (x", 77", A", V'") € 3" for every n e N. 



Let us note that all 3" are closed and, since these sets are contained in the compact 2)i these sets are also 
compact. Hence, the sequence (a;", r?". A", V'")neN has the limit point (a;"'^, rf , A°, i^P) € S^. Considering, if need 
be, the subsequence, we can assume that it is the limit of the sequence itself. 

For all t,7, A € T, (x, ■i/') € X x X, denote by ^P^^;^(^;a;,V') the set of p £ U{t) that realize the maximum of 
'K'^{x,t,p,\,'ilj). For all 7, A € T,{x,il)) e X x X, the compact-valued map t x,'!/') has a measurable 

selector by virtue of [18, Theorem 3.7]. Then, by [45, Lemm 2.3.11], for an arbitrary function (x, ip) € C(T,XxX) 
the map t h-^ {x, tp){t)) also has a measurable selector. Therefore, since relation (33a) also depends on x, tp 

and on the parameters 7 and A upper semicontinuously, and all the relations are integrally bounded on bounded 
sets, by virtue of [45, Theorem 3.5.6], on each finite interval for the funnels of solutions of (4a)-(4&),(33a), we 
have upper semicontinuity by 7, A. In particular, since 7ra ^ and A" }P , the upper limit of the compacts 
3" is included in 3- Hence, (a;°°, 77°, A°, 1/'°) G 3- 

On the other side, by w e {Null)(u^) and by optimality of r?", vP for their problems, we obtain 

- ^n^ArTMrn) > r\rn) > Kirn) - 7n 

therefore, we have 'yn2,w['n^]{Tn) < 7I. By w°|[x„,oo) = '?"l[r„,(x))i we obtain 

2'w[v'']{t) < jn Vt€T. (33b) 

For each t G T, passing to the limit as n — )> 00, we obtain that £tu[7)'^] < 0; i.e., £w[Ti^]{t) = for all t G T. Since 
w e {Null){u"), we have »?° = u° a.e. on T, hence = x° and (a:°, w°, A°, V°) € 3- Moreover, from (336), we 
have ||£»[j7"]||c^0. □ 
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